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ABSTRACT 

A project was conducted to improve the product i vi ty 
and efficiency of 10 manufacturers by providing workplace literacy 
instruction to workers lacking basic skills required for their jobs, 
and to improve the capability of educational programs to meet the 
basic skill needs of the manufacturing industry by developing an 
evaluation manual for basic skills programs. The 2-year project 
conducted literacy audits at 10 manufacturing companies, assessed 
3,291 workers, developed customized assessments and curricula, and 
provided 104 courses to 948 participants in the Chicago area. The 
project did not reach as many participants as had been planned, due 
to small classes resulting from employers' inability to grant 
sufficient release time for employees. However, more than the 
anticipated number of courses were conducted. A no-cost 6~month 
extension allowed the project to serve a higher population of 
workers, although this number was only 62 percent of the anticipated 
number. The project was evaluated and a program evaluation manual 
based on the experiences of the project was produced. The internal 
and external evaluation reports are included with the project report. 
Included in the appendices are copies of the Organizational 
Effectiveness and Employee Development interview forms and reading 
and mathematics test score data and statistical analyses for six 
manufacturing comparies. (KC) 
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Compare actual accomplishments to the objectives contained in the approved 
application. 



GOAL: The goals of the project were. 

1 . to improve the productivity and efficiency of ten manufacturers by providing 
workplace literacy instruction to workers lacking basic skills required for their jobs 

2. to improve the capability of educational programs to meet the basic skill needs of the 
manufacturing industry by developing a "Manual for Evaluating the Impact of Basic 
Skills Programs". 

GOAL I OBJECTIVES: 

1 . To establish Employer/Employee Basic Skills Committees by month L 

This goal was achieved within the first month of initiating the project at each site. 

2. To conduct literacy audits and needs assessments for ten manufacturing companies by 
month 4. 

This goal was achieved by the fourth month of iniating the project at each site. 

3 . To plan a process for measuring program outcomes and impact and collect baseline data by 
month 3. 

Baseline data was collected by month 3 at each site. 

4 To develop/select assessment instruments for participating companies by month 4. 
This goal was achieved by the fourth month of initiating the project at each site. 

5. To identify competencies and basic skills for ten manufacturers and develop customized 
curricula by month IS. 

This goal was achieved within the time frame. 

6. To select and train 15 workplace literacy instructors by month 5 and as needed 
The project selected and trained 18 workplace literacy instructors prior to start up 
of courses. The project achieved 115% of the goal. 

7 To recruit and pre-post test, and counsel 2600 workers by month 14. 

The project recruited and pre-tested 2987 workers by the Fourth Quarter (1 2th month.) With 
the no-cost extension, the project recruited and pre-tested a total of 3291 workers which was 
127% of the goal. 
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8. To schedule 96 modules and provide instruction to 1525 participants by month 16. 

The project scheduled 72 modules by the 18th month of the project. Due to a late start-up at 
some sites and unanticipated down time at some sites, the project requested a six month no-cost 
extension. By the end of the project, 104 .courses were provided which was 104% of the goal. 

By the 15th month of the project, only 37% of the target number of participants had received 
instruction. Because of this, the Project Director requested a six month no-cost extension. At 
the end of the no-cost extension, 948 clients had received instruction. This was only 62% of the 
goal. The reason for not meeting the goal of the number of participants was a higher estimate of 
the class size in the proposal than the actual enrolled. 

9. To measure the learning of 1525 participating workers by month 16. 
By the end of the project, 948 participating workers had been evaluated. 

10. To conduct formative and summative project evaluation using an external evaluator by 
month 18. 

This goal was achieved by month 24 (at the conclusion of a 6 month no-cost extension). 



GOAL II OBJECTIVE. 

11. To produce and disseminate the Manual for Measuring the Impact of Basic Skills Programs 
in the Manufacturing Industry by month 18. 

Because the Manual was the culmination of all project activities, the development coincided with 
the conclusion of the approved 90 day close-out. 

The project disseminated the manual to ERIC Clearinghouse on Adult, Career & Vocational 
Education, Division of Adult Education & Literacy Clearinghouse on Adult Education and 
Literacy, and the Curriculum Coordination Center Network. 
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Refer to the schedule of accomplishments and their target dates contained in the 
approved application and give reasons for slippage in those cases where established 
objectives were not met. Include any corrective measures taken to correct slippage. 



The schedule of accomplishments and completion dates are summarized in the previous section. With 
the no-cost extension, all objectives were met with the exception of the target number of participants. 
The schedule of accomplishments and completion dates are summarized in the previous section. 

The reason for not meeting the objective of teaching 1525 participants is that project over-estimated 
the class size in the application. We originally estimated an average class size of 1 5. In reality the class 
size was much smaller primarily due to scheduling constraints which limited the number of workers that 
could be released from the shop floor for classes at one time. Average class sizes for the companies 
were: Amurol - 15; Burgess-Norton -11; Commander Packaging -11; John Crane - 9; ITT McDonnell 
& Miller - 10; Land O' Frost - 7; Phoenix Closures - 6; Tricon Industries - 7; and Videojet -11. 

It is important to note that while the project did not attain its objective regarding the number of 
participants, the project actually exceeded its goal of the number of courses to be provided. 



m. For projects involving direct services to individuals, identiify the number and 
characteristics of project participants who completed planned project activities 
and of those who did not, and the outcomes achieved by participants who completed 
project activities. 



1 . Mean Age Participants: 41 

2. Sex: No. Males 266 No. Females 330 (Non duplicative Lata) 

3. Race/Ethinicity: No. who are: (Non duplicative data) 
White 166 

Black 50 
Hispanic 295 

Am. Indian/Alaska Native 0 
Asian Pacific Islander 85 

4. No Limited English Proficient: 380 (Non duplicative data) 



Outcomes (Cumulative data) No. Participants 

a. Tested higher on basic skills 550 

b. Improved communication skills 271 

c. Increaded productivity 821 

d. Improved attendance at work 821 

e. Increased self-esteem 821 

Years with the company (Non duplicative data) No. Participants 

Unemployed 0 

0-5 ' 323 

6-10 116 

11-15 97 

1 6-over 90 



Note: upon occasion, participants declined to provide information, therefore, the totals may differ. 
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IV. Report on any dissemination activities. 



Dissemination activities consisted of making presentations, publishing information about the project, 
and disseminating publications and curriculum. 



Presentations 

The following presentations were made to disseminate information about the project as well to advance 
the field of workplace literacy: 



May 1994 Linda Mrowicki, Director, and Douglas Jones, Consultant, participated in a panel at a 
state-wide Workplace Literacy Conference. The title of the presentation was "If They 
Work Together, Shouldn't They Learn Together? Cooperative Learning Models for 
Workplace Literacy Programs." 

May 1994: Consultants/Trainers Douglas Jones, Tess Locsin, Lynn Olivi, Colette Poindexter, 

Laima Schnell, and Vickie Woodruff presented a two-part presentation on Effective 
Basic skills programs. 

Mar. 1994: Linda Mrowicki presented an overview of basic skills programs to staff at El Camino 
Community College in California. 

Feb. 1994: Linda Mrowicki chaired a panel at a statewide workplace education conference. The 
topic was on the integration of basic skills programs into the company strategies. 

1993 : Linda Mrowicki, co-presented three two day Train - the -Trainer workshops 

on How to Conduct Literacy Job Task Analysis and Develop Curriculum in Florida. 

Oct. 1993 . Linda Mrowicki served on a panel of workplace literacy providers at theMO Literacy 
Investment for Tomorrow's state conference. 



Dec. 1993 . Linda Mrowicki, Douglas Jones and Colette Poind exter presented on the components 
of Basics Skills Programs to the Chicago Chapter of the American Society of Training 
and Development. 

Dec. 1993 : Linda Mrowicki co-facilitated a curriculum working group for the Colorado State 
Community College System workplace ltieracy project. 



Nov. 1993: Douglas Jones was featured on "This Week With 32", a local TV station that addressed 
the need for basic skills programs in the workplace. 

Summer 1993: Colette Poindexter was featured on CBS News "Eye On America" that examined 
successful basic skills programs. 

March 1993 : Linda Mrowicki participated on a panel of basic skills experts to discuss 

professionalizing the field at the International TESOL Conference in Atlanta, Ga. 
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Oct. 1 992: Linda Mrowicki was an invited speaker at the Workforce Education Business 

Roundtable on workplace tests and the assessment process 
Sept. i992: Linda Mrowicki chaired an employers' panel at the U.S. Department of 

Education Project Director's meeting. The topic was "Curriculum Development". 

May 1992: Linda Mrowicki, Douglas Jones, Monica Lynch, and Tess Locsin, presented a three hour 
session of Effective Workplace Literacy Programs" at a statewide literacy conference. 



Linkages: 



Douglas Jones serves on the Train America's Workforce Committee of the Chicago Chapter of the 

ofTaT; 5 T T ng Develo P ment - ™» committee membership facilitates^ Z£km 
of basics skills issues in the organization's annual training plan. 'nciusion 

Douglas Jones and Laima Schnell are members of the Illinois Workplace provider group which meets 
bi-monthly to discuss common issues and concerns in workplace education. 

Fall 1993: The project was selected as a model demonstration site for the identification of best 
practices m workplace basic skills programs by the University of Illinois - National 
Center for Research ,n Vocational Education. The program results and best practices will 
be disseminated through the U of I -NCRVE work. 



Publications 

The project was referred to in a CCASTD article about basic skiiis programs in May-June 1 994 and in 
the Jan. - Feb. ,ssue of ACTION - A Bimonthly Update from the Chica|ola„d Chamber of Commerce 

£5*" di ~ ed brochures and infoma ' ion abow i,s se ™» "p- »*~ * *>* 

The project also distributed 214 copies of its workplace publications to people in the field. 



V. Report on any evaluation activities* 



The project maintained data on a quarterly basis. This data was used to internally monitor progress on 
achieving its goals. A copy of the final quarterly report is found in Appendix A. 

The external evaluator's report can be found in Appendix B. 



VI. Report on any changes in key personnel. 

There were no changes in key personnel. 
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Appendix A 



Workplace Education Division of 
THE CENTER - Resources for Education 



WORKPLACE LITERACY 
PARTNERS for the 
MANUFACTURING INDUSTRY 
in CHICAGO and NORTHERN ILLINOIS 



V198A20112 



8th Quarterly Report April - May 1994 



Prepared by: 

Lynn Olivi, Consultant/Trainer 
Linda Mrowicki, Project Director 



with the assistance of 
Sally Granick, Administrative Assistant 



For more information contact: 
Linda Mrowicki, Project Director 
Workplace Education Division of THE CENTER - Resources for Education 

1855 Mt. Prospect Road 
DesPlaines, IL 60018 

708/803-3535 
FAX 708 - 803-3231 



NATIONAL WORKPLACE UTEHACY PROGRAM 
INFORMATION FORM 



1. Target No. to be Served: 1525 



2. da Smad at F?m Site m Qaia; (ciass siocs) 
at. t. us at. c 52 

Site 2. 177 S!ia 7. l3 ' 

ate 3. 11 aia & 57 

ata 4. 115 aiafl. 165 

SIta & 13(T aia to . " 59 

3. TotaJ No. Sarvad: 948 



4. Fad. Funds Obligated? 455 » 607 - 00 
* £ Matching Funds/ In-Kind? 120 ' 838 - 97 
** fi. Vaiua Release Time: 236 * 095. 37 

7. lfa_2anianaiinaJii_EaaBins 
SkiDs 



GEO 
ESL 



"3lT 



8. Contact Hours Provided: 21.289 

(Comae: Heura ata tha numbar erf 
taacfang hour* thai worker* 



This data rapraaancs unduplicacad participants 

Pan ?• ganiciBffllfln Oaa 

1. Maan Aga Partcxpanta; ^1 

■i a.,^ eMrnfpfty. ^ - |1 -j in |]||| 



Whrta 
Black 



166 



Am. Indian/ 
Alaska Na&va 



■ ■" — mjL. ■■ «ww naovi 

Hiapantc 295 Aeisn/P aciilc 

Islander 



2.Sa«:No.Alaiaa^_No.F <tma i M 330_ 

4. No. angj» erf Household: M /fl _ 

5. No. Umrtad English Proficient: 



380 



85 



6.2msamsa 



a. Taatad higher en basic ikifla 

b. Improved csnsnuntcadon aaiua 
c Increased productivity 

d. Improved attendance at work 
a. Jncraaaad aatf oetaom 
Includes employers' contributions of 
management time, office space, 
duplication, materials, classroom 
space and refreshments for 
participants 



wo. ganteaams 

550 



.271 



,821 



,821 



ML 



7, Ynnn *** rf ™ ™ g tia^2aasiaaas. 

Unemployed 
0-6 

11-1S 

1B*jver qf) - 
** Raleaae time lnclud.* »»~.T~ 

i» — .. u^r^'" °- ■>» 

assessments, and counseling. 




— Upon occassion participants declined co provide Information re qu . SCetl p „ c 
• therefore che the totals nay hoc be equivalent. 
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BEST COPY AVAILABLE 



WORKPLACE LITERACY PARTNERS FOR 
MANUFACTURING INDUSTRY IN NO^Tern^NOIS 

EMPLOYER MATCH 
Quarter April - May 1994 



Companies 

Amurol Products Co . 

Burgess-Nort on Mfg. 

Commander 
Packaging 

John Crane 

ITT M & M 

Land O'F rost 

Parco Foods, Inc. 

Phoenix Closures 



Management/ 
Supervisor Time 
($) 



$30.00 



Tricon 



Videojet 



TOTALS 



Amurol Products Co. 

Burgess-Norton Mfg. 

Commander Packaging 

John Crane 

ITTM&M 

Land O'Frost 

Parco Foods, Inc. 

Phoenix Closures 

Tricon 

Videojet 



Emol.M«t 



$30.00 



$30.00 



$90.00 



Workers Release 
Time (hours) 



456 



249 

552 



195 



1,452 



Value of 
Workers Release 
Time 



$5,818.05 



$3,603.03 
$10,002.72 



$4,544.00 
$23,967.80 
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Management 


Supervisor 


Worker 


$30.00 


$25.00 


$11.55 


$30.00 


$25.00 


$12.60 


$30.00 • 


$25.00 


$13.00 


$30.00 


$25.00 


$14.47 


$30.00 


$25.00 


$16.03 


$30.00 


$25.00 


$11.00 


$30.00 


$25.00 


$11.20 


$30.00 


$25.00 


$11.00 


$30.00 


$25.00 


$16.00 


$30.00 


$25.00 


$11-69 
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Ten Manufacturing Companies 
In The Chicago, Illinois Area: 
A Report of Process and Outcomes 
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Workplace Literacy Programs for Ten Manufacturing Companies In The Chicago, 
Illinois Area: A Report of Process and Outcomes 



Thomas G. Sticht 

Consultant in Workforce Education & Lifelong Learning 
Introduction 

In 1992, the Workplace Education Division of THE CENTER / CCSD # 54 (THE CENTER) of Des 
Plaines 'Illinois, as lead agency, in partnership with the Management Association of Illinois (MAI) were 
awarded a National Workplace Literacy Program (NWLP) grant from the U. S. Department of 
Education. The grant was awarded to provide workplace literacy programs to industries in the Chicago 
area that were undergoing organizational changes to introduce one or more Total Quality Management 
(TQM) procedures. 

Total Quality Management procedures typically involve the introduction of new skill demands on line 
employees. Though not all plants introduce all aspects of TQM, the procedures introduced generally 
result in changes in the ways that employees must work. Frequently employees must change from 
working alone to working in teams, they must change from performing limited functions to performing a 
number of different steps and operations to produce a completed product, they must change from 
having quality determined by an inspector at the end of a production line to building-in quality 
themselves by conducting varic as measurements and charting the results in what is known as "statistical 
process control-SPC," and they must frequently engage in more communications with customers. 
Additionally, in some cases the introduction of new technology requires that employees engage in 
training programs that are brief, intense and place a premium on good reading, studying, problem 
solving, mathematics and communication skills. 

Business Partners 

In the Chicago area, THE CENTER /MAI team became partners with ten businesses that were 
implementing one or more aspects of TQM. Through a preliminary needs assessment, it was determined 
that these industries had a combined workforce in which some 30% -50% were lacking or weak in the 
basic English, literacy, or mathematics skills needed to work effectively in the new TQM environment. 
The businesses that were studied and a brief description follow: (Note: These descriptions reflect the 
businesses at the time of the preparation of the proposal to the U. S. Department of Education.) 

"Amurol Product Company manufactures specialty confectionery products. Of the 395 employees, 
there are 310 production workers on two shifts. In an effort to increase market share and due to the 
nature of business, new products are continually being introduced. Although the majority of sales are to 
domestic customers, new growth markets are being cultivated out of country." 

"Burgess-Norton Mfg. Co. is involved in the development and manufacture of piston pins, shafts, 
powdered metal parts, castings and keys, and sub-assemblies. These products are primarily produced for 
the automotive, truck and agricultural industries. A few of their major customers include John Deere, 
Ford, General Motors, Caterpillar, and Chrysler. The company has been in business in Illinois since 
1903 and currently employs 512 people at two locations. The company has a goal of doubling sales 
volume by 1996. A basic skills problem stands in the way of achieving that business goal." 



"Commander Packaging is a corrugated box manufacturer. The company has two plants in the 
Chicagoland area that employ 126 production employees who are members of the Graphic 
Communications Union. The company manufactures about a thousand custom orders each month. Their 
customers continue to demand more measurement and control of the manufacturing process. These 
demands result in more complex machinery, as well as a need for higher skill levels from all. The 
company is in the beginning stages of implementing Statistical Process Control in a plant-wide 
improvement process. " 

"ITT McDonnell & Miller manufactures boiler feeders, water cutoffs, steam vents and pressure 
regulators. The company has a workforce of 300 employees with 170 in production; the majority of 
whom are members of the International Brotherhood of Boilermakers. In an effort to increase 
productivity, ITT has developed "production centers" and "focused factories." The next phase will be 
formalized SPC training for all employees." 

"John Crane, Inc is a manufacturer of mechanical cells. Major customers include pump companies, the 
automotive industry, and other petroleum-related businesses. The company has a total workforce of 
1,455 with approximately 841 involved in production. The company, in order to become more 
productive and increase its competitiveness, is employing the use of employee involvement and 
Statistical Process Control efforts, in order to increase employee effectiveness. In addition to the Total 
Quality Management, innovative work flow is being affected by the introduction of work cells." 

"Land O'Frost manufactures shelf - stable food products and MRE (Meals Ready To Eat) for the 
military and was one of the primary food providers for Operation Desert Storm. The company has a total 
workforce of 275 which includes 225 production employees who are members of the United Food 
Commercial Workers. 1 * 

"Parco Foods, Inc. is a leading baker of specialty cookies in the United States. The company supplies 
baked and frozen dough to a wide variety of wholesale and institutional distributors, as well as retailers 
of cookies such as MacDonald's. Approximately 21 1 members of the General Service Employees Union 
are employed on a full-time basis with up to 100 additional individuals employed seasonally." 

"Phoenix Closures, Inc. develops, manufactures and markets closures, fitments and container sealing 
systems used in packaging a wide range of consumer, industrial and institutional products. Since 1982 
the company has manufactured thermoplastic caps exclusively. The employment at Phoenix Closures 
has stabilized as their market matured so that nearly 300 individuals are employed today. Of that total, 
208 are members of the Amalgamated Clothing & Textile Workers Union. In an effort to remain 
competitive, the company modernized processes and developed new products, as well as initiated a Total 
Quality Management program. " 

"Tricon Industries, Inc. is manufacturer of custom inserted molded components for the automotive 
industry and switches for the appliance industry. Since the company was started in 1944, it has 
expanded to 340 employees in four locations. Over the past two years Tricon has experienced significant 
growth in direct labor positions and support personnel." 

"Videojet Systems International is a subsidiary of A. B. Dick Company. The company manufactures 
continuous stream ink jet processing printers and specialty inks. The production force totals about 270. 
The company has plans to implement SPC and an overall employee involvement initiative." 
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were for reading/writing, 35 were for mathematics, 6 were for preparation for the high school 
equivalency examination (the GED), and 2 were communications courses called "Customer 
Interaction." 



Number and Costs of Employees Receiving Instruction. The data in this section is taken from the 
final quarterly report for the project. It shows that a total of 3,291 employees were assessed for basic 
skills across the ten industries and across all eight quarters of the project. This is 127% of the 
proposed goal of 2600 to be assessed. However, while the assessments exceeded the projected 
numbers, the courses actually enrolled only 948 employees, about 62% of the 1,525 that had been 
established as the goal for the project when originally proposed to the U. S. Department of Education. 

Of the 948 employees who participated in courses, their average age was 41 years and 226 (45%) were 
males while 330 (55%) were females. In terms of race/ethnicity, 166 (28%) were White 50 (8%) were 
Black, 295 (49%) were Hispanic and 85 ( 1 4%) were Asian/Pacific Islander. 

The cost of the project in federal funds was $455,607. For the 948 employees, this comes to $480 60 
per employee student. When the additional in-kind funds ($120,839) are added to the federal costs the 
sum is $576,446 or $608 .07 per employee. Finally, when the value of the release time that companies 
provided is added to the previous costs, the total is $814,541or $859.22 per employee. 

A total of 21,289 instructional hours were provided at a cost of $21 per hour in federal funds and $38 
per hour when all funds are considered. On the average, since each worker received about 25'hours of 
instruction (21,289/948=22.46), the federal costs per employee were $561.50 and total costs were 
about $950 per worker, as indicated above. 

Evaluating the Workplace Literacy Programs 

Evaluation of THE CENTER / MAI workplace literacy programs was accomplished by both internal 
and external evaluation activities. In the internal activities, the Project Director at THE CENTER was 
responsible for obtaining and reporting all of the data presented above on numbers, types and costs of 
courses. The Project Director was also responsible for supervising the quality of all aspects of the 
various program start-up, development, implementation and reporting activities. The Project Director 
working with staff, was also responsible for obtaining all the pre- and post-test data and for 
administering and recording the interview questionnaires used to determine employer and employee 
perceptions of the workplace literacy courses. 

The external evaluation activities consisted of siifl visits by the external evaluator to some of the 
locations and classrooms where instruction was carried out. This permitted the external evaluator to 
verity, on an unsystematic sampling basis, that quality instruction was being offered and that employers 
and employees were able to make judgments regarding the benefits of the instruction to them and the 
company. 

In evaluating the workplace literacy programs, there were two main bodies of information that were 
developed. One dealt with how the program contributed to the organizational effectiveness (OE) of the 
business or industry involved in the program, and the other involved the effects of the program on 
employee development (ED). v 8 

The OE Perspective 

From the perspective of the employing organization, workplace literacy programs are implemented to 
improve the organization's performance of one or more of its major human resources functions. These 
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functions include public relations, recruitment, training, employee behavior, productivity (job 
performance) monitoring and improvement, and advancement and promotion of effective employees. 

In evaluating the workplace literacy programs, the external evaluator designed interviews that were 
administered to an unsystematic, convenience sample (obtained by the Project Director) of managers 
and supervisors to determine whether in their judgment, the workplace literacy programs had 
contributed to one or more of these organizational functions. A copy of the interview schedule is 
included at Appendix B. 

Table 1 summarizes the Organizational Effectiveness interviews for seven companies for which a total 
of 21 interviews were conducted by THE CENTER staff. The remaining three companies were not 
sampled due to the time and expense involved in making numerous appointments and then re-scheduling 
when supervisors and/or employees could not make previously scheduled meetings. Repeated 
cancellations of scheduled meetings occurred because of business factors even when the external 
evaluator had traveled to the Chicago area with previous appointments made. 

Public Relations and Recruitment Functions. The combined data indicate that, for the most part, the 
supervisors interviewed were unaware of whether or not the programs had helped the companies' public 
relations (e.g, through newspaper stories or company newsletters) or employee recruitment functions. 
Three supervisors at Amurol, John Crane and ITT M&M thought that the programs had improved their 
companies' ability to recruit new employees. The supervisor at John Crane thought this was so because 
the company offered workplace literacy programs now. Presumably, this would permit John Crane to 
recruit from a larger pool because it would not have to reject as large a number of less literate 
applicants. 

Training Function. Two-thirds of the supervisors thought that the workplace literacy programs had 
improved their companies 1 ability to conduct training. Specific comments included: 

Table 1 . Responses of supervisors to interviews regarding the effects of the workplace literacy 
programs on organizational effectiveness in various human resources functions. 



Organizational Effects 



Company 


Public Relations 
Yes No DK 


Recruit Employees 
Yes No DK * 


Conduct Training 
Yes No DK 


Emplovec Behavior 
Yes No DK 


Amurol 


1 2 


1 2 


2 


1 


3 




Burgess-Norton 


1 1 


2 


2 




1 


\ 


John Crane 


1 2 


1 1 1 


2 


1 


2 


1 


ITT M&M 


1 1 


1 1 


1 


1 


2 




Phoenix 
Closures 


4 


1 3 


3 


1 


2 


1 1 


Tricon 


3 


3 


2 


1 


3 




Videojet 


4 


4 


1 


3 


2 


2 



Totals 0 4 17 3 4 14 13 3 5 15 5 1 
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Organizational Effects 



Comnanv Productivity Promotions Other Effects Continue Program? 

Company r ca^ ^ ^ ^ dk ^ No DK ^ ^ QK 

Amurol 3 12 12 3 

Burgess-Norton 2 2 2 2 

John Crane 2 112 2 112 

ITT M&M 112 2 2 

Phoenix 

Closures 2 2 3 1 4 3 1 

Tricon 2 1 2 13 12 

Videojet 3 14 3 1 4 



Total T0~^ 8 7 9 5 17 0 4 7 0 14 

Burgess-Norton: (1) "Math classes will help with SPC; English classes will help with team training; 
employees more confident." (2) "Shouid help with SPC training." 

John Crane: (1) "They're capable of training their co-workers." (2) "Better communication." 
ITT M&M: (1) "Basic skills will help them with training." 

Phoenix Closures: (1) "Easier to train. "(2) Soi . employees easier to train." (3) "Easier to train." 
Tricon: (1) "Easier than before - pay more attention to details." 
Videojet: (1) "Helped with other classes." 

Employee Behavior. Seventy-one percent of supervisors thought that the workplace literacy programs 
had affected empSoyee behaviors on the job. Specific comments included: 

Amurol: (1) "People participating in program were more involved because they could communicate 
more ideas." (2) Employees have displayed some improved satisfaction that company has made an effort 
to provide help." (3) "Participants have exhibited an increase in self image which in turn has helped them 
in teamwork, helping in a positive manner in all work related duties." 

Burgess-Norton: (1) "Speak more." 

John Crane: (1) " — has improved a bit. She's more confident now than before. - — is about the same." 
(2) "Morale & teamwork is rising due to the increased confidence in communications." 

ITT M&M: (1) "In, v oved attitude about the company-people seeing company doing something for 
them." (1) "A greater willingness to write out ideas, less afraid." 

Phoenix Closures. (1) Teamwork improved." 

Tricon: (1) "Increase morale, confidence to participate in teams." (2) "Morale." (3) "Morale higher." 
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Videojet: (1) "Some improvement." (2) "Understands better." 

Productivity Function. In some cases the workplace literacy program may help improve an 
employee's job productivity through the reduction of errors, wastage, or other such efficiencies. In the 
present case, over one-third (36%) of the supervisors interviewed stated that they thought the 
workplace literacy programs had helped improve productivity in one way or another. 

John Crane: (1) "Rising levels of effective communication is reducing the amount of scrap." 

ITT M&M: (1) "More accuracy in reporting." 

Phoenix Closures: (1) "Some, not all employees improved productivity." (2) "Less scrap." 

Tricon: (1) "Reduce errors paperwork." (2) "Better on paperwork. Fewer errors paperwork. More 
conscientious." 

Videojet : ( 1 ) "Understands and asks . estions more now. " 

Promotion Function* At times, employee's basic skills levels may be too low for them or the company 
to consider them for promotion. In the present project, five supervisors in three companies thought that 
for some employees, their participation in the workplace literacy programs had increased their chances 
for promotion. 

Amurol: (1) "This is too early to evaluate at this time. — was a back up line leader and more fully 
utilized as a line leader. The improved skills were of some assistance." 

John Crane: (1) "In case there will be an opening, — is qualified to be promoted." 

ITT M&M: (1) "Trap line is more self-reliant, leslf dependent on salaried people." (1) " It hasn't 
happened yet because there isn't much movement, but he predicted people will be easier to train." 

Phoenix Closures: (1) "Potential to promote. "(2) "One may be ready to promote "(3) Some have 
promoted. Some will." 

Other Effects. In almost four out of five cases (80%) the 21 supervisors who responded to the 
organizational effectiveness interview stated that there were other effects that the workplace literacy 
programs had had in addition to those previously discussed. Specific comments included: 

Amurol: (1) "Safety-helped people to read important signs & machinery parts; Data Collection-helped 
people understand appropriate paperwork; Communication-with supervisors improved." 

Burgess-Norton: (1) "One communicates more now with supervisors. Supervisors more confident 
employees understand instructions." (2) "Positive attitude-liked class or getting off work." 

John Crane. (1) Tve noticed that most workers who participated improved their self confidence 
speaking and working " (2) "Employee confidence-better command of speaking/writing- Employee 
participation increased-result of confidence; Empowerment & team building can be focused on 



7 40 



ITT M&M: (1) "Positive attitude-people appreciate it & feel better about the company." (1) Classes 
have helped people understand information at work & indirectly ISO 9000." 

Phoenix Closures: (1) "Spelling improvement; Involvement in meetings increased." (2) "Enthusiastic 
about learning." (3) "More willing talk at meetings." (4) "More aggressive about jobs-try improve their 
skills." 

Tricon: (1) "In promotable status-some participants will be more likely to promote than before. "(2) 
"Self-esteem improved." (3) "Better understanding-speak better (ESL students); Math better for SPC." 

Videojet: (1) "Eager - talk to others - 1 especially." (2) "Took shyness away." (3) "Not afraid to 
communicate now; Takes more initiative-starts on own." 

Will the Company Continue the Program? This question was included to get yet another indication 
of the extent to which companies valued the workplace literacy programs. It is not likely that companies 
would want to continue programs that they did not feel were valuable. 

In the present case, seven (33%) supervisors at four companies stated that they thought the company 
wanted to continue the programs. Specific comments included: 

Burgess-Norton: (1) "Planning to continue beyond grant. Prefer 1/2 on company time, 1/2 on employee 
time because of impact on production schedule." (2) "Committed to continuing on own. Took longer 
for employees to reach goals than he anticipated. Apprehension about the classes has subsided." 

John Crane: (1) " We are looking into a state grant." 

Phoenix Closures: (1) "Would like to see training continue. Will be more training (union will be 
conducting training)." (2) & (3) "Will continue (union will be conducting training). Think good idea to 
continue. 

Tricon: (1) "Math training-positive & negative numbers." 

Summary of the OE Responses. Summing across the "Yes," "No," and "Don't Know" columns of 
Table 1 gives 72 "Yes," 28 "No," and 68 "DK" responses. If attention is restricted to only the "Yes" and 
"No" responses, there were a total of 100 responses, of which 72% were "Yes," indicating that the 
program has had a positive effect on one or more organizational human resources functions. 

While the interviews were open-ended and permitted supervisors much leeway in responding, the fact 
that so many "Don't Know" responses were recorded suggests that supervisors were not responding to 
the interview with a simple bias toward positive responses. Rather, they seemed to be reluctant to 
comment when they felt that they did not know enough to comment. 

That so many of the supervisor's responses commented on the new found confidence and self-image of 
employees is a perception that they shared with the employees themselves, as was indicated in the 
employee development interviews summarized later on. 

The ED Perspective 

While the OE perspective places the needs of the organization at the forefront of program evaluation, 
the employee development (ED) perspective looks at how the program is serving the interests of the 
employee in both the workplace and in other settings. Becoming involved in a job- based education 



program can motivate employees to seek more responsibility at work, it can affect their attitudes toward 
schooling and learning, and this can affect their behaviors toward their children, spouses and others. It 
can motivate employees to continue their education outside of the workplace. All these changes can, in 
turn, increase the "marketability" of the person and influence supervisors and managers to a greater 
appreciation of the person as an employee, and this may be reflected in increased pay and promotions or 
a job change. These types of employee developments serve to indicate that the workplace literacy 
program has produced a degree of "portability" of literacy skills in the employee. 



Learning Outcomes 

The first type of information that is useful in determining ED effects is information about how well the 
employees learned in the various courses. Information regarding learning outcomes were obtained by 
the internal evaluation staff. This information included data on the percentages of enrollments, drop 
outs, and success rates of those who completed the various courses. Additional information was 
obtained using job-related English, reading/writing or math tests that were administered as both pre- 
and post-tests to measure the extent to which employees learned what was taught in the courses (see 
the example in Appendix A). Pre- and post-test data from courses in six companies were provided to 
the external evaluator for analysis and reporting. 

Course Completion and Success Rates. Of the 948 employees who participated in the 104 workplace 
courses, 33% were enrolled in ESL programs, 34% in Math, 26% in Reading/Writing, 5% in GED 
preparation, and 2% in Customer Interaction programs. There was an 1 1% drop out rate across all 
programs. For the 89% who remained in the programs, there was a 95% success rate in which 
employees met the standards for mastering the competencies taught in the courses. The standards for 
the competency-based courses was that at the end of the course, 90% of employees will demonstrate 
the competencies taught in the course. 

Demographics of Employees With Test Score Data. To determine if employees had learned what was 
taught in the job-related reading and mathematics courses, tests were constructed using job materials 
and asking for task performance similar to that needed for reading or computing on the job. Only one 
form of each test was constructed. It was used for both pre- and post-testing. It was expected that 
because there were several weeks and some 36 or so hours of instruction between the pre- and post- 
tests that the gains exhibited would reflect learning due to instruction and not just practice in taking the 
test once before taking it again. The procedure of constructing alternate forms of tests for pre- and 
post-testing that were psychometrically equivalent was too technical for the internal evaluator staff and 
would have been too costly for the project's budget if tests had been developed by either internal staff or 
external consultants. It would also have demanded considerable participation by employers and 
employees beyond that which was devoted to instruction, and such additional time and personnel 
commitments from the industries involved were not feasible. 

In the case of the mathematics tests, they were decontextualized problems in computational operations 
(add, subtract, multiply, divide) from the Tests of Adult Basic Skills (TABE). Because the tests were 
excerpts and not complete tests, use of the norming data for the TABE was not appropriate. 

Table 2 shows data from eleven courses conducted at six companies. Demographic data for each 
company is summarized in the following. 

Burgess-Norton: Data for one reading and one mathematics course were available from Burgess- 
Norton. There were 9 employees in the reading course, all of whom were ESL students. Eight were 
male and all w°re Hispanic. Ages ranged from 29 years to 57 years, with a mean of some 40 years. Four 



had 6 years of education, one 10 years and 3 had completed 12 years of education. They had been 
employed from 1 to 17 years, with 1 year being the median. 

For the 35 members of the mathematics course, 28 (80%) were males, and 9 were ESL. Thirteen (37%) 
were White, 13 (37%) were Black, and 9 (25.7%) Hispanic. Their ages ranged from 25 to 60 years, 
with an average age of 40 years. Ten were 45 years old or older. Their years of education ranged from 8 
to 12, with over 18 having 12 years of education. They had been employed anywnere from 1 to over 21 
years, with 26 (74%) having been employed 10 or fewer years. Only two had been employed for less 
than one year. The median years of employment was 6. 

John Crane: Data from one reading and one mathematics course were available from John Crane. Of 
the 16 employees in the reading course, 9 were male and all were ESL language users. There were no 
Whites or Blacks in the program. Regarding ethnicity, there were 6 (37.5%) Hispanics, 4 (25%) Asian, 
and 6 (37.5%) Other. Their ages ranged from 30 to 64, with an average of 46 years. Nine were 45 years 
old or older. Their years of education ranged from 5 to 13, with 6 having 12-13 years of education. The 
median years of education was 9.5. They had been employed from 6 to 20 years, with a median of 12.5 
years of employment. 

Of the 14 employees in the mathematics program, 13 were female, and 13 were ESL speakers. There 
were no Whites, there was 1 (7%) Black, 2 (14.2%) Hispanics, 1 (7%) Asian, and the remaining 10 
(71%) were Other. Their ages ranged from 25 to 67 years, with an average of 42 years. Their years of 
education ranged from 4 to 8 years, with a median of 4.5. They had been employed from 4 to 23 years, 
with the median years of employment being 6. 

ITT McDonnell & Miller: There were 21 employees in the reading program for which data were 
available. Fifteen of the employees were males, and 19 were native English speakers. There were 10 
(47.6%) Whites, 7 (33.3%) Blacks, and 4 (19%) Hispanics in the class. Ages ranged from 34 to 63, and 
the median was 48 years of age. Nine were over 50 years of age. Their years of education ranged from 3 
to 17, with 1 1 having 12 or more years of education. The median was 12 years of education. They had 
been employed from 1 to 27 years, with a median of 1 3 years of employment. 

Phoenix Closures: Data were available for one reading and one mathematics course at Phoenix 
Closures. In the reading course, there were 13 employees, of whom 7 were females, and 10 were ESL 
speakers. Four (30.7%) were non-Hispanic Whites, and the remaining 9 (69.2%) were Hispanic. Ages 
ranged from 24 to 45 years , with a mean age of 37 years. Years of education ranged from 6 to 12, with 
a median of 9 years. Years of employment ranged from just over a half year, to 13 years, with a median 
of 6 years. 

In the mathematics course, there were 38 employees who participated. Six of these had also taken the 
reading course. Of the 38 employees in the course, 13 were males and 25 females. Sixteen were native 
English speakers and 22 were ESL speakers. Eighteen (47%) were non-Hispanic Whites, 19 (50%) 
were Hispanics, and 1 was Asian. Age data were available only for the six employees who had taken the 
reading course, and ages ranged from 28 to 44 with 4 being over 40 years of age. Years of education 
ranged from 4 to 12, with a median of 9. Years of employment ranged from 2 to 11, with a median of 5 
years. 

Tricon: Data were available for three courses at Tricon, two reading and one mathematics course. One 
reading course was for employees in general, and the second was only for employees in the production 
division of Tricon. Demographic data were available only in the course for general employees. In this 
course, 17 of the 19 employees were female and were ESL speakers. Ages ranged from 26 to 52, with a 
median of 35 years of age. Two (10%) were White, 3 (15 7%) were Black, 8 (42%) were Hispanic, and 
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5 (26%) were Asian. Years of education ranged from 6 to 16, with a median of 1 1 . Median years of 
employment was 1.5, with a range from 0.2 to 14 years. 

In the mathematics class there were 1 1 employees, 9 or whom were female. Four were ESL speakers. 
Seven (63 6%) were White, 2(18%) were Black, and 3 (27.7%) were Asian. Years of education ranged 
from 8 to 12, with 8 having 12 years of education. The median age was 47, with the range going from 
34 to 54 years. Years of employment ranged from 0.8 to 14, with the median being 3 years. 

Videojet: The 15 employees in the reading program with data from Videojet were 7 males and 8 
females, all of whom were native language speakers. Six (40%) were Black, 6 (40%) were Hispanic, 
and 2 (13.3%) were Asian. Years of education ranged from 8 to 16 years, with a median of 12, and 
years of employment ranged from 2 to 16, with a median of 6. 

Pre- and Post-Test Scores. It is clear from the mean scores of Table 2 that in all cases, employees 
did considerably better on the post-tests than they did on the pre-tests, suggesting that all courses 
resulted in learning by the participants. Indeed, out of the total of 209 pre- and post-test scores across 
all courses and companies, 207 showed positive gains and only two showed post-test scores lower than 
pre-test scores, and both of those were in the mathematics tests which were multiple-choice and 
permitted guessing. A complete listing of test scores by company and course is given in Appendix C. 

Table 2. Means and standard deviations (SD) of pre- and post-test scores on job-related reading and 
math tests in eleven courses at six companies. All entries are raw scores correct except for John Crane- 
Reading which are percent correct. All pre-post gain differences are statistically significant using t-tests 
xbr paired means. 



Company 
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Reading 

Pre 

X 


SD 


Post 
X 


SD 




N 
Pre 
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Math 
SD 


Post 
X 


SD 


Burgess-Norton 


9 


18.7 


19.7 


32.0 


12.3 


35 


21.7 


28.3 


28.3 


11.3 


Max. Possible: 




47 








44 










John Crane 


16 


44.3 


22.2 


70.8 


18.9 


13 


26.3 


04.8 


34.3 


06.7 


Max. Possible: 




100% 










48 








ITT 


21 


29.2 


10.7 


40.9 


06.1 












Max. Possible: 




56 


















Phoenix 


13 


45.7 


16.5 


99.5 


08.4 


38 


28.9 


06.6 


38.4 


05.6 


Max. Possible: 




125 










48 








Tricon 


19 


35.3 


09.3 


58.9 


10.4 


11 


18.0 


07.5 


27.9 


05.8 


Max. Possible: 




74 










34 










19 


11.1 


04.6 


18.1 


02.9 












Max. Possible: 




21 


















Videojet 


15 


38.5 


05.4 


52.3 


03.1 












Max. Possible: 




62 



















Employee Interview Responses. The test score data indicated that employees did, in fact, learn job- 
related knowledge in the courses they attended. However, some literacy educators have speculated that 
workplace literacy programs that focus on job-related knowledge may result in learning that has little or 
no transfer, "portability, M or generalizability to situations outside the workplace. 
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To get some idea about how employees felt about the value of the workplace literacy programs for 
work, home and community, the structured interviews asked for detailed information as indicated in 
Tables 4, 5, 6, 7 and 8. 



Table 3 presents a summary of the responses from the 22 employees interviewed in four companies. 
Clearly, the workplace literacy programs were not viewed as entirely restricted to helping the employees 
at work. Summed over the four companies, more than half thought that the programs not only helped 
them at work, but also at home. Some 40% thought the programs had helped them in their 
communities. 



Table 3. Employee responses to interviews about how the workplace literacy programs had helped 
them. 

Has This Workplace Literacy Program Helped You At: 



Company 



N 



Work 



Home 



Community More Education 







Yes No 


DK 


Yes 


No 


DK 


Yes 


No 


Dk 


Yes 


No 


DK 






% 


% 


% 


% 


% 


% 


% 


% 


% 


% 


% 


% 


Burgess-Norton 


5 


76 


16 


8 


64 


18 


18 


33 


67 


0 


80 


0 


20 


John Crane 


8 


65 


27 


8 


33 


67 


0 


69 


31 


0 


50 


37 


13 


ITTM&M 


5 


91 


7 


2 


64 


36 


0 


95 


5 


0 


100 


0 


0 


Tricon 


4 


76 


21 


3 


58 


42 


0 


25 


75 


0 


75 


25 


0 


Videojet 


5 


62 


19 


19 


58 


42 


0 


55 


35 


10 


40 


60 


0 



Note: This table shows the percentage of Yes, No, or Don't Know responses to questions about the effects of participating in workplace 
literacy programs on work, home, community, or desire for additional education. For instance, considering John Crane, there were 8 
employees who answered 10 questions about the effects of the program on work. Thus there might have been 80 responses. However, 
because one of the questions was about a math program, and none of the employees at John Crane took a math program, the math 
question was not applicable to these eight students. Therefore the potential of 80 responses was reduced by 8 to 72. Then, because a 
second question on teamwork was not applicable to these 8 employees, because they all worked alone, the' potential of 72 responses 
was reduced by 8 to 64. The table shows the percentage of the 64 remaining responses that were Yes, No, or DK responses. For John 
Crane, 65% of the 64 responses were Yes, 27% were No, and 8% were DK. Similar procedures were followed in constructing the 
remaining data in the table. 



Contributions to National Education Goals. National education goal number 6 (in the Goals 2000 
Act) calls for adults to engage in lifelong learning. Importantly, over half of the employees stated that 
their participation in the workplace literacy program had stimulated an interest in participating in 
additional education, suggesting that the programs have contributed to the achievement of goal number 



National education goal number 1 states that all children will enter school ready to learn and it places 
quite a bit of responsibility upon parents or grandparents for preparing their children for 'school by 
reading to them during the pre-school years. Examination of Tables 4, 5, 6 and 7 reveals 12 of the 22 
respondents had no children or grandchildren to read to. But of the remain 10 employees 40% said that 
due to the workplace literacy program they now read more to their children. This suggests that the 
workplace literacy programs may also contribute to the achievement of Goal 1 
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Table 4. Employee Development Effects 
Burgess-Norton 

Has this ESL/Read &Write or Math 
program helped you at work: 

1 . Read job materials better? 

2. Write job materials better? 

3. Listen & speak on the job better? 

4. Do math for job tasks better? 

5. Work better in teams? 

6. Reduce waste; scrap; errors; etc. ? 

7. Know more about company policies, etc.? 

8. Feel confident about trying for promotion? 

9. Learn better in company training programs? 

10. Improve your morale with company? 



Yes 

3 
3 
3 



No DK Example/Comment 



Some words; Sometimes-more words 

Understand more now. Understands verb tenses. 
Speaks more; understands better now. 

Refresh memory; Better understanding now. 

(n/a - all work by themselves) 
2 ( 1 ) Less errors in paperwork. 

1 (2) Understands better now, 

1 2 (1) Maybe later. 

(n/a- none have taken other training) 



Has program helped you at home? 

1 1 . Have you started reading more at home? 

12. Do you write more/better at home? 

13. Do you use math better at home? 

14. Do you help your children/ 
grandchildren with homework more? 

1 5 . Do you read to (grandchildren more? 



Uses dictionary to read paper in English. 
Does homework for community college 
course. Reads little more now. 

Before couldn't write anything. 

( 1 ) More comfortable now. 

Has daughter in 4th grade-help each other. 
(4 n/a) 

(1 n/a) 



Has this program helped 
you in your community? 

16. Do you feel more confident 
about reading in stores, offices, etc.? 

17. Do you feel more confident 
writing in government forms, etc.? 

18. Has this program made it 
easier for you to speak in public? 

19. Has this program made you 
feel more confident about reading 
and understanding the issues for 
voting in the next election? 



No problems with this type of reading. 



Usually have forms in Spanish too. 
No problems in this area. 

More confident; tries more. Depends on 
conversation. More comfortable now. 

Not citizen; thinking about becoming 
a citizen. 

Not too much - use different words. 



20. Has the program lead you to 
consider taking more education 
or training programs? 



Studies with videos at home-Spanish/English. 
Taking community college class-ESL Maybe 
weekends. Baby sits during week. Time problems. 
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Table 5. Employee Development Effects 
John Crane 





Yes 


No 


DK 


Example/Comment 


Has this ESIVRead & Write program 
helned vou at work: 










1 . IxCaU JOD lualClialS UCUC1 : 


7 


1 




Read iob forms better 


2. Wntejob matenals better? 


3 


A 

4 


1 


Short sentences 


3. Listen & speak on the job better? 


0 
0 






Not ashamed now. Speak better. 


4 Do math for iob tusks better^ 








(n/a) 


5. Work better in teams? 


7 


1 




Easier to understand others. 


6. Reduce waste; scrap; errors; etc. ? 


1 


s 


2 


A little. 


7. Know more about company policies, etc.? 


8 






(8) Understands safety better now. 


8. Feel confident about trying for promotion? 




6 


2 


Need more English. Too old. Need to read better. 


9. Learn better in company training programs? 








(n/a- none have taken other training) 


10. Improve your morale with company? 


8 






Can talk to boss better. Very Happy. 


Has program helped you at home? 










1 1 . Have you started reading more at home? 


4 


4 




Read paper at lunch time. (2) Read paper. 


12. Do you write more/better at home? 


1 


7 




Notes to daughter. 


1 3 . Do you use math better at home? 








(n/a) 


14. Do you help your children/ 
grandchildren with homework more? 


1 


3 




(4 n/a) Help more with math than with English. 


1 5. Do you read to (grandchildren more? 


2 


2 




(4 n/a)Reads to child. Reads when babysitting. 


Has this program helped you 
in your community? 










16. Do you feel more confident 
about reading in stores, offices, etc.? 


8 






Read signs better. 


17. Do you feel more confident 
writing in government forms, etc.? 


5 


3 




(2) Driver's license. Fill forms out better. 


18. Has this program made it 
easier for you to speak in public? 


6 


2 






1 9. Has this program made you 
feel more confident about reading 
and understanding the issues 
for voting in the next election? 


3 


5 




Not citizen. 


20. Has the program lead you to 
consider taking more education 
or training programs? 


4 


3 


1 


Like to try. If didn't have child. Computer classes. 
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Table 6. Employee Development Effects 
ITT McDonnell & Miller 

Has this ESL/Read & Write/GED 
program helped you at work: 

1 . Read job materials bttter? 

2. Write job materials better? 

3. Listen & speak on the job better? 



Yes 

5 
5 
4 



No 



4. Do math for job tasks better? (n/a) 

5. Work better in teams? 5 

6. Reduce waste; scrap; errors; etc. ? 4 1 

7. Know more about company policies, etc. 5 

8. Feel confident about trying for promotion? 5 

9. Learn better in company training programs? 4 1 



1 0. Improve your morale with company? 3 

Has program helped you at home? 

1 1 . Have you started reading more at home? 3 

1 2 . Do you write more/better at home? 4 

1 3. Do you use math better at home? (n/a) 

14. Do you help your children/ 1 
grandchildren with homework more 9 



1 5. Do you read to (grandchildren more? 



DK Example/Comment 



Understand gauges & work orders better. Easier to 
read words & expresses self better. 

Can fill out work order & tickets better. Helped fill 
out papers better w/fewer errors. 

(1 n/a) Tremendous difference. Less shy; voice 
better. Can use more words. More ability to explain 
how work should done. Understand English better. 



Listens to others more. Hear their opinion. More 
considerate now of others. More able to understand 
other people & express his thoughts. Can explain 
better. Communicates better with different people. 

Wastes less time now when writing. More thorough 
now & has a better work ethic. Helped him become 
neater. Can read instructions better which helps 
reduce scrap. 

(5) Read & understand rules/policies better now. 

Became a group leader! Confident he knows his job 
well & can do any job. Made him more confident of 
reading ability "to handle different situations." 
Feels he is able to achieve in a harder job. 

He slows down and reads more carefully. Reads 
directions better. Can listen better & pay better 
attention. Gets along better w/people from 
different cultures. Works better w/people; better 
communication. 

Feels better at work. Felt good that 
company offered him a program. Felt 
encouraged to write. 



Helps wife with schoolwork. Newspapers & Bible. 

Better penmanship & spelling. Writes down 
fishing conditions for future reference. Starting to 
write checks & pay bills more. Writes notes from 
Bible to show his father. Writes about what other 
countries are producing on their farms. 



(3 n/a) Helps daughter with reading. 



(3 n/a) 



Has this program helped you 
in your community? 

16. Do you feel more confident 5 Read labels easier. Understand medical forms better, 

about reading in stores, offices, etc.? 
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17. Do you feel more confident 
writing in government forms, etc.? 

18. Has this program made it 
easier for you to speak in public? 

19. Has this program made you 
feel more confident about reading 
and understanding the issues 

for voting in the next election? 

20. Has the program lead you to 
consider more education 
programs? 



5 Able to explain himself better. Filled out a car 

registration last night. (2) Fill out forms better. 

4 1 More comfortable/confident. Thinks before speaks. 

Less shy. 

4 ( 1 n/a - not citizen). Read/listen to news better. 



5 More job-related schooling. Taking courses for taking 

stationary engineers license. Pursue writing, or training 
Automotives or computing. Improve English with 
private tutor. Community college GED possibly. 
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Table 7. Employee Development Effects 
Tricon 

Yes 

Has this ESL/Read & Write program 
helped you at work: 

1 . Read job materials better? 4 

2 . Write job materials better? 3 

3. Listen & speak on the job better? 2 

4. Do matfi for job tasks better? 

5. Work better in teams? 4 

6. Reduce waste; scrap; errors; etc. ? 3 

7. Know more about company policies, etc.? 4 

8. Feel confident about trying for promotion? 1 

9. Learn better in company training programs? 1 

1 0. Improve your morale with company? 3 

Has program helped you at home? 

1 1 . Have you started reading more at home? 1 

12. Do you write more/better at home? 2 

13. Do you use math better at home? 

14. Ek> you help your children/ 2 
grandchildren with homework more? 

1 5. Do you read to (grandchildren more? / 

Has this program helped you 
in your community? 

16. Do you feel more confident 2 
about reading in stores, offices, etc.? 

1 7. Do you feel more confident 
writing in government forms, etc.? 

1 8. Has this program made it 2 
easier for you to speak in public? 

1 9. Has this program made vou 
feel more confident about reading 
and understanding the issues 

for voting in the next election? 

20. Has the program lead you to 3 
consider taking more education 

training programs? 



No 



2 
4 
2 
4 



DK Example/Comment 

Terminology clearer. (2) Read forms better. 
Lots better. 

1 More sure of what said. Very improved, 

(n/a) 

(3) Communicate better with others. 

(3) Less mistakes with paperwork. 

(4) Understand policies better now. 

Would like to apply for better job. 

Took SPC class. Understood paperwork better. 
(3 n/a- have taken no other training) 

(2) Feel better about self. 
Reads bills better. 

Try write more. Writes notes to teacher, 
(n/a) 

(2 n/a) Daughter helps her too. 

(2 n/a) Reads to her little boy. Easy to read 
children's books. 

(2) Goes self now, before needed interpreter/help. 



Lot more comfortable now. More confident. 



Might take classes at community college for 
better /different job. Maybe to learn more English. 
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17 



50 

BEST COPY AVAILABLE 



Table 8. Employee Development Effects 
Videojet 

Has this ESL/Read & Write program 
helped you at work: 

1 . Read job materials better? 

2. Write job materials better? 

3. Listen & speak on the job better? 

4. Do math for job tasks better? 

5. Work better in teams? 

6. Reduce waste; scrap; errors; etc. ? 

7. Know more about company policies, etc.? 

8. Feel confident about trying for promotion? 

9. Learn better in company training programs? 

10. Improve your morale with company? 



Yes 

4 
3 
5 



No 
1 

2 



DK Example/Comment 



Understands paperwork more. Fills forms more. 

Understand better. 

(n/a) 

1 (2) Understand more now. Little better now. 

2 Less mistakes with paperwork. 

(2) Understand rules/policies better now. 



Two took other classes but ESL class didn't help. 
(3 n/a- have taken no other training) 

A little. More comfortable speaking now. 



Has program helped you at home? 

1 1 . Have you started reading more at home? 

12. Do you write more/better at home? 

1 3. Do you use math better at home? 

14. Do you help your children/ 
grandchildren with homework more? 

15. Do you read to (grandchildren more? 



(2) Newspapers. (1 ) magazines. Understands more. 
Write notes to kids, husband. Writes short notes, 
(n/a) 

(3 n/a) Helps 8 year old. Help each other. 
(5 n/a- no little children/grandchildren) 



Has this program helped you 
in your community? 

16. Do you feel more confident 
about reading in stores, offices, etc.? 

1 7. Do you feel more confident 
writing in government forms, etc.? 

18. Has this program made it 
easier for you to speak in public? 

1 9. Has this program made you 
feel more confident about reading 
and understanding the issues 

for voting in the next election? 

20. Has the program lead you to 
consider taking more education 
or training programs? 



1 

4 
1 
1 



Dont always understand, but asks questions. 



More comfortable. Ask questions. 



Likes to read about politics. 



Like to take more classes at school. Has taken 
more classes outside work. 
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Conclusions and Recommendations 



Over the last year the external evaluator observed workplace literacy classrooms in action at several of 
the manufacturing companies described earlier in this report. He also conducted extensive discussions 
with the Project Director and teaching staff, and with supervisors and employees at several of the 
companies. 

Conclusions: Based on the foregoing activities and the data presented above, certain conclusions 
regarding the workplace literacy project under review seem appropriate: 

(1) . THE CENTER / CCSD #54, Management Association of Illinois (MAI) and the ten manufacturing 
companies involved in the project formed successful partnerships to bring workplace literacy programs 
to 948 employees in the Chicago area. Although 108 courses were provided (108% of goal), the project 
served 948 workers which constituted 62% of the total originally anticipated in the proposal to the 

U. S. Department of Education. 

(2) . The Project Direct.' and staff indicated that they have developed interpersonal skills and 
operational procedures that permit them to repeatedly enter into a business, set-up an education 
coordination team, conduct a basic skills needs analysis and assessment with managers, union members 
and employees, develop job-related assessment instruments and administer them, develop and deliver 
job-related English language, reading/writing, and mathematics programs on company sites at times 
convenient to the employers and employees. 

(3) . Supervisor judgments, job-related test score data, and employee judgments all converge to suggest 
that the workplace literacy programs (a) produced improvements in job-related basic skills; (b) in many 
cases improved productivity through the reduction of wastage and errors; (c) improved morale and 
employee confidence on the job, at home, and in the community and (d) contributed not only to the 
organizational effectiveness of the companies involved but also to the achievement of national education 
goals 1 and 6 in the Goals 2000 Act. 

Recommendations: The recommendations have to do with actions to increase the amount of usable 
data in future projects. 

(1) . The external evaluator should be involved earlier in the project. This could result in the 
development of assessment instruments earlier and in their earlier use to obtain a larger corpus of 
information that is more representative of the total number of courses offered and employees served. 

(2) . THE CENTER has now conducted work with over forty different companies in the Chicago area. 
It should now be possible to draw upon the body of job-related materials and tasks from previous 
projects to develop alternative forms of job-related assessments that sample across various specific jobs, 
are normed on regional workers and which could be used as pre-and post-tests in each new program to' 
determine the extent to which the workplace literacy training results in more generalizable work-related 
basic skills. This could be done with consultation from psychometricians in the Chicago area. 

(3) . Consideration should be given to the use of a brief, 20 minutes or so, assessment instrument that 
provides an indication of how well employees perform relative to a national sample. Something like the 
TABE locator test, or a quick test of vocabulary that provides national percentiles would be useful to 
indicate the degree of literacy development is needed to achieve high levels and how much is actually 
achieved in these brief workplace literacy programs. 
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(4) . Future projects should consider the various organizational functions identified in the Organizational 
Effectiveness interview and how the project can increase the numbers of "yes" judgments. For instance, 
most of the supervisors interviewed were unaware of any Public Relations benefits of the workplace 
literacy courses. Perhaps an informational brochure and a briefing could be developed that could 
educate managers and supervisors about the various OE functions and suggest how they could get 
public relations, recruitment, etc. benefits from participating in the project. 

(5) . Future projects should consider the various categories of benefits on the Employment Development 
interview and develop ways to increase benefits. For instance, a simple pamphlet or a video in English, 
Spanish and other high frequency languages might be developed to explain the national education goals 
and how the employees can use their workplace literacy experience to contribute to the various goals. 
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Appendix A 

Sample materials from job-related reading task test develop- 
ment activities. 

[Note: Only one page of the job-related reading task test is presented. The 
test is much longer] 
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READING/WRITING ASSESSMENT 



Background 

In mid-February, 1993 The CENTER administered a customized reading/writing 
assessment to employees across all three shifts at , and in early April 

several additional assessments were completed. The total number of employees assessed 
with this instrument was 312. All employees completed a common portion of the 
assessment. Additionally, employees in the areas of production, shipping/receiving, and 
brazing completed a job-specific supplement. 



Rssiilis 

A frequency distribution of the scores from the assessment, including any supplement, is 
shown below. 



Assessment 


No. of 


Scores 


Employ? 


95-100% 


121 


90-94 


84 


85-89 


35 


80-84 


21 


75-79 


11 


70-74 


8 


65-69 


6 


60-64 


4 


55-59 


5 


50-54 


7 


45-49 


2 


40-44 


4 


0-39 


4 


Total 


312 


Average 


88% 


Range 


16-100% 
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Assessment - All Employees 

Directions: Complete the Scrap Ticket below using the following information. 

You are an operator in Department 22 on second shift. Use today's date and 
your own operator number, 

The production is going to Department 11. It is production number 85782-300 
for United 

Your daily scrap is 24 pieces of part number 204-001 88 ( revision D. caused by 
underfills, slug marks, and flash. Your daily scrap also includes 14 of 
component number 002-00699E and 12 of component number 002-00700E. 



NOM-COtrOfeJlNO UATEAIAL 
lOCNTIflCATlCN AMD UOVC TICKET 



SMlfT i , 



INITIATED 0Y 
OATC l . 



prom ozrr. 

SAJCA) 



some? or sc/u* 

Q WJCCTf fMM WAT 
Q LOf MCJCCriGH If ftC 



TO CCPT. 
<ARCA> 



IN PROCESS 
ROUTING 

Q to SOUP UC€ 

Q rc* mat 
Qhouo rc* at- it* 



vcctrtCJUXY wur if MXomiM oh wcouct 



PROOUCTI0N I i 
CUSTOMER i 
TBI CON PART • I 
REVISION LEVEL t 



PINAL DISPOSITION 



return to 

VENOOfl 



^ INSTRUCT I ONSl 



□ 
□ 



ACCEPT NOTED NON-CONFQRNI TV 



OTHER i. 



O.A. SlCNAlUnCf. 
DATE I 



ENTER BY DUALITY COST ACCOUNTING 
□ VES BY I 



□ 



NO 



DATE i 



LIST CGMPOTCNT SCRAP PART NLMftCASi 



L. CHrvl, WORKPLACE PROJECT/AduM Lornmfl Rttouret Ctrttr, Dtt PtairoM (rtv 1/15/93) 
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Appendix B 

Copies of the Organizational Effectiveness and Employee Development 
interview forms used in the workplace literacy program evaluation. 
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Organizational Effectiveness Interview 
Date: Interviewer: 
Name of Organization: 
Name of Program: 
Name and Position of Participant: 
Extent of Knowledge of Program: 

Has this program helped your organization in 

1 Public Relations (newpaper articles, TV or radio coverage, etc.)? 

Yes No Don't Know If yes, provide some 

specific examples. 



2. Ability to Recruit Employees? Yes. 
Provide specifics. 



No. 



Don't Know. 



3. Ability to Conduct Training? Yes. 
Provide specifics. 



No 



Don't Know. 



4. Employee Behavior? (attendance; morale; teamwork; etc. ) 
Yes No Don't Know Provide Specifics. 



5. Employee Productivity? (reduced wastage; better quality; etc.) 

Yes No Don't Know Provide Specifics (give 

numbers where possible). 
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Employee Promotions? (upward mobility of derving employees). 

Yesl No Don,t Know Provide Specifics (names; 

positions; how many; etc. 



7. Other Organizational Effects? (List and describe). 



8 Will your organization continue this program after federal funds 
are gone? Yes No Don't Know Discuss pros and cons. 
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Date: 



Employee Development 

Interviewer: 



Interview 



Organization: 
Program: 

Has this program helped you at work: 

1. Read job materials better? Yes No Don't Know. 

If yes, give an example. 



2. Write job materials better? Yes No Don't Know. 

If yes, give an example. 



3. Do math for job tasks better?Yes No Don't Know. 

If yes, give an example. 



4. Listen & speak on the job better? Yes. No. 

Don't Know If yes, give an example. 



5. Work better in teams?Yes No Don't Know 

If yes, give an example. 



6. Reduce wastage; scrape; errors; etc. ?Yes No_ 

Don't Know If yes, give an example. 
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7. Know more about company policies, how the company works, 

personnel policies, safety procedures, etc. ?Yes No 

Don't Know If yes, give an example. 



8. Feel confident about trying for a promotion or new 

position?Yes No Don't Know If yes, give an 

example. 



9. Learn better in company training programs? Yes No_ 

Don't Know If yes, give an example. 



10. Improve your morale, happiness with company, etc.? 

Yes No Don't Know If yes, give an example. 



Has this program helped you at home? 



11. Have you started reading more at home? Yes No Don't 

Know If yes, give an example. 



12. Do you use math better at home?Yes No Don't 

Know If yes, give an example. 



13. Do you write more/better at home?Yes. 
Know If yes, give an example. 



No„ Don't 



14 Do you help your children/grandchildren with homework more? 

Yes No Don't Know If yes, give an 

example. 



No 



15. Do you read to children/grandchildren more? Yes. 
Don't Know If yes, give an example. 



Has this program helped you in your community? 

16 Do you feel more confident about reading in grocery stores, 

government offices, department stores, etc.?Yes No. 

Don't Know If yes, give an example. 



17. Do you feel more confident about writing in government forms, 

automobile registrations, etc. ?Yes No 

Don't Know If yes, give an example. 



18. Has the program lead you to consider taking more education or 

training programs?Yes No Don't Know 

If yes, give an example. 



19. Has this program made it easier for you to speak in public? 

Yes No Don't Know If yes, give an example. 



20. Has this program made you feel more confident about reading 
and understanding the issues for voting in the next election 
Yes No Don't Know If yes, give an example. 
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Appendix C 

Reading and Mathematics test score data and statistical analyses for six 
manufacturing companies that participated in the workplace literacy 
project 
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